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, A „ w _ A „, 1C . m it/fFTHOD Further in accordance with the present invention, there is 

SECURITY APPARATUS AND METHOD ^ issod8tcd wilh ^p p ] yin g e 

BACKGROUND OF THE INVENTION service to a user, comprising the step of: recognizing a user 

desiring the service: supplying ihc service to the ustr if the 

1. Field of the Invention ^ s user U recognized; deciding whether ihc user is under a 
The present invention relates to a security apparatus and sinjarklD [0 usc mc service; deciding whether a non-user 

a method for supplying a service to a user by oonJirming n into a use area of the service; and controlling the 

use situalioD of the user and infringement sitoaton ot suppJy bf ^ MW £ce if the user is not under ihc situation lo 

non-user in order to keep safety and reliability tor tne ^ ^ service or if the non-user is intruding into the use 

service. 10 are a of the service. 

2. Description of the Related Art Further in accordance with the present invention, there is 
A method to specify the user in service-usc area by ^ provided a computer readable memory containing 

electrical means and to execute security for each kind of computcr _ reaJ d a b|e instructions lo supply a service to a user, 

service is very important in present electrical society, van- comprising; instruction means for causing a conrputer to 

ous kinds of security means, for example, memorized 1$ recognizc a during die service; instruction means for 

numbeT, magnetic card, 1C card, wireless curd, sound ctmsiEg a computer to supply the service to the user if the 

comparison, fingerprint comparison, retina comparison and uj ^ r ^ cecosv i x ^ instruction means for causing a computer 

face comparison, have heen used. However, tbe memorized ^ wfaelher ^ ^ ^ UD a c r a situation lo use tbe 

number, the rnagneLic card, the TC card and the wireless card servicc . ^traction means for causing a computer to decide 

specifies the user by information only the user knows or with 30 a ^.^cr intrudes into a use area of the service; 

a memory device key for only the user- Therefore, ibey are ^ instruction mesns for causing a computer to control a 

in danger of being used unjustly- supply of the service if the user is decided not under the 

On the other hand, sound comparison, fingerprint Nation to use the service or the non-user is decided to 

comparison, retina comparison, and face comparison are intrude into the use area of the service, 

effecrive personal confirmation means to defect an other's ^ 

unjust use because the user's physical features arc used as a BlUEF DESCRIPTION OF THE DRAWINGS 

ssarsaL^sstassrs ™, . ... w f=s » 

nofbe interrupted. Therfore, even if an other person changes according to the present invention, 

for the user after the service is begun, the service can not be ^ FIG. 2 is a block diagram of the situation detection section 

interrupted, in short, this kind of service includes danger that of the security apparatus according to the present invention, 

the other person utilizes the service unjusty. This kind of 3 is a flow chart of processing of a service supply 

problem is included in the memorized number, the magnetic permission section according to a firs L embodirncrU of the 

card, the IC card and the wireless card. present invention. 

As mepHored above, tbe known security apparatuses 35 piG. 4 is a flow chart of processing of the service .supply 

include followinu. problems. permission section according to a second embodiment of the 

(1) After security is cancelled by confirming the user, present invcnb'on. 

security function is not executed while supplying the ser- pj G s ^ a flow c ^ an D f p roC essing of the service supply 

vice. Therefore, even iC an other person t--hanges for the user, permission section according to a third embodiment of the 

the service is still supplied continuously. *»> p^cm invention. 

(2) While supplying the service to the user, it often nG. 6 is a flow chart of prc^^ing of the sendee supply 
happens that an other person watches information not It? be permission section according to a fourth embodiment of the 
disclosed on display from behind the user. 'Ibis problem prtsent invention. 

occurs because sccuriLy is not provided in the physical space ? block ^ ^ ^ rfty milis 

surrounding the user and the apparatus even if security is «* ^ fifth embodimem of tbe present invention. 

Kc pl«i to which other pcisons arTSot excised. pennon section accQnd.ng lo the fifth C mbod, ro «il of the 

r present invention. 

SUMMARY OF THE INVENTION J0 flG q ^ ^ flow chart of processing of the service supply 

II is an object of the present invention to provide a permission section according to a sixrh embodiment of the 

security apparatus and method to supply a service to the user pmssent Invention. 

while safety and reliability for the service arc kept. ^ tlG a flow cnaJt c f processing of the service supply 

According to the present invention, there is provided a permission section according to a seventh embodiment of 

securiry apparatus for adevicc supplying a service to a user, 55 la6 prc5cnt invention. 

comprising: person discrimination means for recognizing a HQ U is a block diagram of the scqurity apparatus 

user requeuing the service; use situation decision means for accor ding lo a eighth embodiment of the present invention, 

deciding whether the user is under a situation lo use the pro 12 * a flow chart of processing of the service supply 

service; mfringemeni siiuauon deciswn means for detecting section accord ing ^ the eighth embodiment of 

whether a non-user intrudes into a use area the service to eo P 

decide whether of the service is f^^JXZT^l FIG. 13 is a schematic diagram of detection of visual bnes 

means for supplying the service to the user in *** *** of the user n\ the image according to the eighth embodiment 

person discrimination means recognizes the user, and for 01 tne user m inc. image mv i & u 

controlling a supply of the service if said use situation dC u» present invention. 

decision means deddes the user is not under the situation to * f 1G. 14 is a now chart of processing of the »™ "?£ y 

use the service or if said infringement situation decision permission section according to a mnlh embodiment of the 

means decides that the security of the service is infringed. present invention. 
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of toe non-user in the ircage according ro the ninth embodi- J^^i^^S U« i of the service 

iDcnt of the present invention. t * 2( p or example, an unmhalmcd 

HO. 16 is a flow chart oC processing of tl^ V s XIM (automatic teller's machine), a portable terminal, or a 
permission section according to a tenth embodiment oi toe uscd by severai pcI5ons may comprise the service 

present invention- supply section 3. 

FIG. 17 is a schematic diagram of supply method lor trie ^ ^ diagram of the situation detection section 

security apparatus by software according to me present ^ ^ ^ ^ ^ feusc(J ^ , way lo dominate tfac 
invention. 10 uscr> detecting the use situation, or detect an infringement 

DfcTAJLED DESCRIPTION OF THE situation. The situation detection section 1 is oompiised of 

mS^^EMBODMENTS an ima 6 e inpui section 11, a person area detection *ojoq 12. 

rRtimuc^u lmcu t j a person comparison section 13, a use situation decision 

The embodiments of the present invention are ricsctioeo ^^oq m m & an infringement situation decision section IS. 
below with reference to the drawings. FIG- 1 is a bJock u ^ ^ an fa^t through a TV 

diagram of lhe security apparatus according to the present camcra jv camera is set in the service use mea for 
invention. The security apparatus of the present invention is TO( j auou dy observing the user to be supplied the service, 
comprised of a situation detection section 1, a service suppty Tfac cfSon area detection section 12 analyzes images input 
permission section 2 and a service supply section 3. The ^ ^ sccLfon u ^ monitors the secure area 

situation detection section 1 discriminates the user in 2Q tomlllciD piit i ma ge. For example, a cHfterencc between the 
service-use area, detects whether the user is under a situation . e ^ backgrimDd (uiiinhabitcd area) indi- 

to use the service (use sicuauon) and delects whether a ^ ^ ^ p rcscn t in the secure area. The person area 
non-user infringes the security of the user (mtxtngement delecdoI] ^uoa 12 outputs person detection information 
situation). The detection result of the use situation and the Dl ^ ^ cRon prtsem ^ rfctccl ed and outputs non- 
infringement situation is outpulied to the service supply 3J deiecdon ^formation Dl when the person prcscnt i& noi 
permission section. 2 as person information. In this place, the dctcctcf i 

Situation that the user can utilize the service ^ roIDp3rij5Qn ^Uon 13 compares the person 

rhc user » ^Lt* P^t'rea imaged the content of a pe*on comparison 

service and the user ^ 1xs ^^jf^J^^^ diciioaary to specify which person is present in the secure 
ZSTS^^^^ " ■» -Se- & S» comparison denary previously 
^^Ldk£ (4c user inpu* ope^iion to syslem or stores at least comparison 

dbTw ^^^S output From the system). A status of * use the service. The person comparison section 13 outputs 
^S^S^^P^^^ ^ ****** persoodiscTimmationm&rmat^ 

wnen^e user movls away from service use-space «dthin a 35 the service If the person present 

" , ' . 7 permitted to use the service id the person comparison 

predetermined ume. dictionary, the person present is registered as the user who 

The situation Ait a non-user ■ ntnnge* the * «^ ^ be ^ppuJtbe JU». 

user rcpreseois that a person other man the confirmed user ...... .• * A „.u_,w n.. 

toienuTnaUy or accidentally uses the service while the «, The use situation deasion section 14 detects whether the 
SSppUed to the confirmed use, The other person 40 use: is under a situation cap.bbrf astng the ' ««v»a^« 
can then inleTact with the operation or iafonnariou lo be Ihe user of the F»>».«« » ^^^ft^S^ 
disclosed only lo the coofimS user, when the user interact user U n ow u.cluded in the pum t discnmtnaboo nforrna- 
wim the servL appUcation oi the system through a display, noo D2, the user is deeded o be capable o£ using the 
on the display behind the user. ^ service. The use Mtuauon decsoo secuon 14 output use 
oLrw^. P thTothe r person intend to interact with the * situation Mormauon D3 rcpresenUng whether the user is 
service appUcation in the user's absence within the prede- capable of using the service. 

termincd Uroe The >nlrineen»cnt situation decision section 15 detects 

in order to delect each situation, the situation detection whether a non-user infringes the security of the service. If a 
seedon 1 monitors service-use area using imaoe or sound. So penoa other than Lhe user utlhztng the ser^cc now « 
Espedally.theuscsituationoftbeuserand the infringement included in the person domination information D2 he 
situation of the security are detected by the image (person infringement situation decBton section 15 decades that flie 
deTectioa/direaion of face detection/person confirmation) u^^mt^isvOK^vAf^iiamv^ 
and the sound (person detection/person specification/ sanation Mormadou D4 indicates ;a breach of secunLy. The 
chauering detccrion). Monitoring may be wireless. is person detecaon/nonKJetwrion informanon Dl. the person 

b . ' . . . -,. r ,/ discriminauonitiformaUanD2,meusesituaUOTuifi)rinaaoD 

The service supply permission ^J.^^'J^' gT*. infringement situation informaUoo D4 are called 
intcrrupuonAiterrup ion and cancellation/end ofltewvw £ ^ informmon is read out by 

for the serv.ee supply secuon 3 according to ^ supply permission sccUon 2 (step SI b FIG. 3 

resu t of the situation detection *" _ LLSSd rfterwaVd)and referred at steps S3. S4. S8. Sll in 

sendee supply permission section 2 stsrts the supply ot the so ' r 

service when the user is specified in the service-use area. l ' lu ' •*• , 
The service supply permission section 2 controls lhe supply FIG. 3 is a flow chart of processing of the service supply 
of lhe service in at least one of the cases where the user does permission section 2. As mentioned above lhe situafton 
not utilize the service or where the security of the user is detection section 1 discriminates the user in lhe service-use 
infrineed Especially when the user does not utilize the 65 area and monitors tbe use situation and the wfiiagcmeni 
Tervice during the supply of tbe service, the supply of the situation using the image inputted from the JV camera. The 
service finishes. If the security of the user is infringed by person information as detection result oi the situation detcc- 
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Ucn action 1 » «o the servi- supply « J^^St * '~ inVe0tl ° n 

SS/L the service supply section 3. first, the w men use of terminal (second embodiment) 
kiDDlv ttfrmission section 2 obtains the person iDUirmatiQTi 5 ^ ^ fifSt embodiment, another person can not use the 

from LhTsiluaiion detection section 1 (step Si). When the whilc thc user is supplied the scivice through the 

supply of the service begins ("No" at step 82), the service ^ Therefore, the other person must wait to use the 

suiolv permission section 2 monitors the security area in the same lcnriinal the first user finishes In short, in the 

se^cs use area according to the person detect ion/non- firsl embodiment, use by a specified user for ihe terminal 
detection information M (step S3). If a person area is not 10 p3rcllldes by an other person. 

detected ("No" at step S3), processing of the service supply ^ a embodiment, in case the situation for the user 

permission section 2 is rerurned to step SI. On ihe other n0tcaptt ble of using the sendee is detected before the supply 

hand, if a person is delected ("Yes" at step S3), the service ^ f ^ 5crvice for ^ USfir fishes, the supply of the service 

supplv premission section 2 decides whether the person is ^ ri;SCIVcd (interrupted) and the new user can be supplied 

permitted as a user (step S4). As a result, in case die person is ^ fxffm ^ bc ^^_ As a result, during the 

is not permitted as a user ("No* at siep S*), ihe service mtcrrupl io n of the service. a different service is supplied to 

supply permissive section 2 rejects the supply of the service When the original user comes back to the 

(step S5) and returns processing to step SI. In case ihe the reserved service is supplied 10 ihe original user 

person is permitted as a user ("Yes" at step S4), the service aga]n -therefore, while each service is not completed 
supply permission section 2 registers the person as the user 20 ItS p 6Ct j wc jy t piujgl users can be supplied each service from 

(step Sfi). After that, the use situation of the person is me same ^^al out afier another. Additionally, if the 

continuously monitored. The service supply permission sec- ofi&ma i user docs not come back to the same terminal, the 

tion 2 begins the supply of the service (step S7) and returns reserved service is hnished and memory area corresponding 

the processing to SI. to tbc reserved service is relieved to save memory resources. 

The above process steps (step S1-S7) are ihe same as 25 nG 4 ^ a floW ^ m Q f processing of the service supply 

normal confirmation of security (from confirming the user to permission section according to the second embodiment. In 

beginine the supply of the service), In this place, after the ^ t i, at a computer network is commonly used 

supply of the service is begun, the registered user exists in ^ and a plurality of terminals connected to the 

the service-use area and the registered person must be w i Wa & provide a security function. In FIG. 4, steps $15, 

delected at step SI. After the supply of the service is begun, S16> sl7 ^ S18 afe ncW l y added in comparison with FIG- 3- 

ihe processing is relumed to siep S8 through steps Si and ^ canned respectively and supplied the service 

$2. through a respective terminal (step SI, S2). 

The service supply permission section 2 decides urhcLber j D Lnis pjac^ assume that a user A creates a document 

the registered person is using the service according to the use ^ usinfi a terminal A and leaves from Ihe terminal A without 

situation information D3 (step S8). As a result, if the completing the work, The terminal A dctccis thai the user A 

situation of using the service is delected, for example, a ^ not mc service ("No" at step S8) awl that the supply 

user's absence continues above a pie determined lime ("No" of tQC service is not completed ("No" at step SIS). The 

at step S8) > the service supply permission section 2 tcrmi- service of creating the document at the present time is stored 

nates the supply of the service immediately (step S9). Next, ^ ( rcscr ved) in a memory area of the terminal and the supply 

the registration of the user is canceDed (step Sl«) and the ofthc toim *nal is interrupted (step S16 p S17), In this case, the 

processing returns to step Si in order to register a new user. situation for the user not using the service is detected 

On the other hand, the service supply permission section according lo the use situation information D3. Completion 

2 decides whether a non-user infringes the security of the situation of the supply of the service is decided by comp^ 

user according to Lhe infringement situation information D4 45 don notice sent by the user. Next, a user D is confirmed fay 

(step Sll) A* a result if the situation Lhat a non-user the teminal A and wo rks through lhe terminal A. Assume thai 

Lfrmgcs the security is" detected, for example, an other when the user A comes back to the Terminal A, the user B 

person watches the display behind the user during the supply goes away from the terminal A. The terminal A newly 

of the service ("Yes" at step SU), the service supply reserves the results of the service for the user B (steps 

permission section 2 temporarily interrupts the service to 50 SIS, S16, S17) and begins the isupply -otihe reserved service 

maintain security untfll the security is not infringed (step u, lhe user A (steps SS, SU, i>13, S14). The memory area to 

SL2) If a situation that the security is not infringed is store the result of the service is commonly used by each 

detected during the interruption of the service ("Yes" at step terminal on the network- Therefore, it the user B 15 con- 

S13) the service supply permission section 2 cancels the firmed by a terminal B (steps S4, S6 4 S7).the reserved result 

interruption of the service and begins the supply of the 55 of the service for the user B is supplied through ,lb« > luminal 

serX (step S14) B 0**" S8, SU, S13, S14). On the other hand, if the user 

. . . ■„ j ruo b ,^ w ; c A docs not come back to Ibe terminal A during apredctcr- 

In this way, in case the user permitted the sennce is aoww ^ ^ 

specified in the service use area^ the «~ SeTthe ^r A immediately and reheves the memory 

begun. Durinfi the supply of the service i£ U* ^uscr is not {Q ^ service result of the user A (steps 

using the service or if the ^y^^^^^^f % " &&SffT^W • situation of Storing many service 

the service finishes "^^^^ fes^ts in memory axes is prevented. The predetermined time 

maintained dunnfi all periods of <W^^^J oC ^s S^Stanold at step S18 is freel/set by the kind of 

the service. For example, in case the registered user IS ** « r 

effectively protected according lo lhe present in-eolion. of each user is completed, in short, » nghl Servicc-use 
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a ,T\ t ^ fifth embodiment. In FIG. 7, an interactive control section 4 

General by confuting the user is » J ™ £K5»n m common with FIG. 1. FIG. 8 is a flow 

work is completed. The user B does no t ta ™ l"^o2r chart oiling of the service supply permit* section 

O.ei.icrAltoh^uringlbcienmnal.By 2 accordinlz^o the fifth embodiment- In FIG, S, steps S20, 

Ata*i» B B.to«B™»J^^ L^VadL^ps in comparison with FIG. 3. 

infringement for ihe security of the user A. interactive control section 4 receives an indication of 

(b) Bctention for 1 inspeculed user (fluid «*od»«0 JSrflS. warning ofmemfriosemetil and controll* the 

Id the first embodiment, u order to ^ jarpplwdta o{ seivfcc accolding to u« indication. Ibc kind 

service, the w must be confirmed as a registered person PfTJ ^rioa is coniinuadon/iDlerruption/end of the 

In shorl, if the user is not previousdy registered, ho can not ^ ^ ^ q£ ±o bMalSaa byi for 

be supplied the service. However, there * a service to be ■ ^ keyboard. In FIG. 8, during the supply of 

used by many and unspecified persons. Therefore, ma third «=v . b d< .i eClion 1 detects 

embodiment, the service issuppkedto an uiispccifiedpeson ^ ^ . ^ stcp ^ ^ 

without confirmation. At that time, a .eaafmn £ permis rion action 2 send, the warning to the user 

of the ucspeciliedperson * generated and j*""* lS ^ the vainin g, the interactive control 

the supply of the service the user (*e "*">**£W ^ { ^ caiioa of lhc ^ (step S21), m6 

is discriminated from other users by referring to the con- permission section 2 control* the supply or 

parison dictionary. Therefore, the service is supplied lo ^"j£*™o£rdmg to the indication, 

raanv and unspecified persons while me security is main- ^"J^ « f J m of lhc ^ce 

uincd- , - * .t „,i 20 f'CONTINUATlON" at stcp S21), the interactive control 

FIG. 5 is a flow chart of proccssuig of the " ^ of ^ ltion ta ^ sendee 

permission section 2 according tod* th^d embochm=nl_ In «no P ^ t 3 

begun (Ho- at step S2), the service supply penni^on conh ™° s . dica[es iatcrruplioil of the ^vice 

secrionUtectsme^oinrhescr-eeusearca according ^^^^^^ inleractivc cnnlrt i 

tn the nerson deTeaion/non-detection lnformaooD Dl (step i lmiBRRuruvn « •"j' 

user (Step S6> After that, the use situation of the new user Hoc of the mtcnupbon. 

is continuously monitored, and the service supply permis- If the user indicates end of the service END _at step 

Son section zLpn. to supply the service (step S7). In this S21), the interactive control section 4 .outputs the mdicaOon 

way the service js supplied loan unspecified person without pf end to the service supply pern.™ secuon 2. The 

confirmation and the person comparison dictionary is gen- service supply section 3 finishes the supply ol lhc service 

crated lobe registered. Therefore, a new user except tor the l„ this way, when the user receives the warning of 

pre-registcrcd user is able U. be supplied the service. In this infringement, the user can select conrmuataouAnterrupOon/ 

ease during the supply of the service Tor the new user, he is end or service by using inleractivc function. As a result, if 

discriminated from another person by referring lhc peison the user works through equipment in an office, whenever an 

comparison dictionary in order to maintain tbe security. office colleague (person not necessary Jor security) stands 

(C) Warning of infringement (fourth embodiment) behind the user, interruption of the work a excluded. In 
In the wLmbodiment when an infringement situation • snort, a change tor the worse of usc-fccUngof the cquinmem 

of £ ^iSy fa warning is sent to the user. In is avoided. Otherwise, when usmg the equipment m a public 

£ asTTe^ice Sly £Son section 2 controlls place, interruption of the service is indicated by lb e user for 

Sb^i ^rf^^te.nd.torwtoxe-le 4J the warning of a ^en-user standing behind «*^.. . 

mterruption and canccUauon of the service in case of In the fifth embedment. fl» user car. select tb* ^canon 

!nfr.WmJni oV «oiritv •» keep security in case of urrhngemem or the secunty. After 

HcfoTa flow cbar^ ^processing of the service supply *A *° the apparatus (e 4 uiprncnt) car, auto- 

peSSsion mSto fa"cordLg to ihe fourth embodiment* In outolry keep the security of the user .In this ease, if he 

raTS s a newly added stop instead of step S12 so warning of the infringement is outpvlted as an image the 

hu. t.,step»^ isane ly a i ? r understands circumstances around the user by watching 

fKS SU), the scrvice^ipply permission section 2 select the i^crto* (^u^oumcrcip^a of rhe 

LnS a 3ng of the ir^ment loiho W S2Q. service) «cord* fi » the eaco™u«i«.. 

Concretely -speaking, the warning is outputted through an 55 («) DetaH aclloD af neglecting the *anun & (sixth 

imajre (warning .scDtcnce/mark, controlling of color/ embodiment) 

bii K htness/blink) or sound (speaking of warning sentence/ In the sizth embodiment, in case lhc mthcatiDD is not 

warning buizer). Wlicp the user receives the earning, it is RelecLcd by the user within predetermined time after gencr- 

possiblc for tile user to prouci his. security by. for example, aling ^ c warning, the apparatus automatically execute* 

r^ruiiEoffapQwersupplyofibeterniiQalorhidinga 6 o predetermined (default) controlling ot the supply of the 

of thctcrminal. service. This predetermined controlling is freely set by the 

(6) Inrcractive controlling in case of warning (fifth user. % . 

embodinient) FIG. 9 is a flow chart of processing of the service supply 

fa thofi£Ui.mbo^ person section 2. In FIG. ^^^^^J^SI 

,ni rmrrmi me^s fdisnlavl the supnW of the service is 65 arc added steps incompanfian with FIG, 3. The construction 
^Lm^^^S^ S?S warning. FIG. 7 is of. the security apparatus of the fifth ernr^diment is thesame 
" th. security appararus according id the » in FIG. 7. In FIG. 9, during the supply of ihe sennce, ,f 
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sUiiauon ("Y« at step SH), tbe b«rwce ^uppiy » ^» , hw ^p^^t document. Io tin way, 

of the user Iq this case, if no indication of the user in 5 kind of the serviccAnformauon, 

received above predetermined dine (step S22, S23), the ^ thc tie venth embodiment, the security degree is 

interactive control section 4 outpuis the purport of no changed by unit of The scrWce/mfbrniatioii. FIG. 10 u> a now 

indication lo thc service supply pennission section 2. fl)e chfln oJ - p rocc55 i n g D f the service supply permission section 

service supply permission section 2 controlls thc supply of 2 according to the seventh embodiment- In FIG. 10, step S25 
the service according to a predetermined control (step S24). 10 addcd between Sll and S12 is a different Step in comparison 

For example, if continuation of the service is set as the ^ith FIG. 3. During thc supply of thc service, if the situation 

predetermined control ("CONTINUATION" at SLcp S24), detection section 2 detects irmnngement of the security 

the service supply section 3 continues to supply thc service. («Yes" at step Sll), the service supply permission section 2 

If interruption of the service is set as the predetermined citrous thc supply of the service according to the security 
control ("lNTBRRUPTlON" at step S24), thc service supply 1S degrcc ^ by the kind of service/information (step S25). Tn 

section 3 interrupts the supply of the service. If end of the mis c ^ u may be poss fcie that the security degree is set 10 

service is set as the predetermined controlling TEND" at a ^ lool to the mail but not set to a WP loo). For 

step $24), Ihe service supply section 3 finishes the supply of sample, when another person watches the display behind 

thc service. On the other hand, if the indication of thc user ^ llS6r ^ tac mail tool is only interrupted (the mail window 
is received within the predetermined time ("Ye*" at Step ^ ^ c \ ose d) and the wp window is continuously opened. 

S22), thc interactive control section 4 receives the indication ^ for scUing thq sccurity degree, Tor example, the user 

(step S2J) and the service supply permission section 2 ^ d j sctosiirB .p OSS jbie at the head portion of mail to be 

councils the supply of the service according to the indicia- ^ Awindow showing the mail tool dcies not read to the 

rion. In this case, if the user indicates continuation or. the infi ^ gctJlcIll c f the security. As for both sending side or 

service (" CONTINUATION' ' ai step S21) t the interactive rQCciving aidCf ^ raftfl ^ aWc to rcraa in disclosing, 

control section 4 outputs the conization indication to the ^ ^ ^ indicates a strict secret at thc header of a 

service supply permission section 2. The service supply document window to display thc docum cut reacts to 

se^don 3 continues to supply ^ •^"^^^ the infri^cmcnt of security. For example, the sequrhy 

cates interruption of the service ( ^RRUTIW at step ^ pealing the document is dynamically changed by 

S21), Ibe interactive control section 4 outputs the in errup- ^ *^ ^ ^ m document. In this way, even if the 

tion indication to the service supply permission section 2. ^ ^ ^ ^ ^ ^ rf ^ 

The service supply section 3 interrupts the supply ot i the ^ ^ cd or coarinucd according to thc content 

service. If the user indicates end of the service ( bN P at examplet rcgu lar document or strict secret document). 

Rim S2n the interactive control section 4 outpuLs the end """^ .* * ^ , , . _ ... . 

sicp rwsi;, me micracuvc WU u«ji . — ( \ de i C ction of visual line 1 (eighth embodiment) 

indication to the service supply permission section 2. The 35 tieiewian -i^u. ^ *\ e / 

service supply section 3 finishes the supply of the service. In die above embodiments, when another person watches 

In this wav if the user neglects a warning of infringement, the display behind the user mating a document, the 

foj^« t££ ^ it according to a predetermined infringement of security of the user « <~d ; » 

conLT^ction of dekuit) Otherwise, it is possible to is not necessary to pay attention to the „tt ^ » ^ 

control the supply of the service different form the prcde- < 0 pay attention to the visual line (or line ' f 

^rmked contml for some reasons by a user's indication in For example, whey the visual line of the user leaves he 

c^ of the warning. For example, io an olEce, as for the screen of the display, the Window may be dosed. In the 

Z<Z LerredV^enevcr a Llieaguc stands behind the eighth embodiment, by ( detecting a visual W of the uscr a, 

uZ^UnfiV equipment, thc uL does not have to use siruadon, the supply of the service is interrupted when 

indic^tf continuation of the service. The predetermined 45 the visual bne leaves the screen. 

control is Already set as continuauon of thc service. In this FIG, 11 is a block diagram of the stuahou detection 

case the user can continue the operation while neglecting section 1 according to the eighth embodiment. A visual line 

the warning In case the user operates thc equipment in a detection section 16 is an added section in comparison with 

public place the predetermined control is set as interruption FIG. 2. The visual line detection section 16 dctccis raove- 

of the service. In this case, security of the user for the Jn mem of the visual line of the user in case the user 

equipment is protected while he neglects the warning. (registered) is included in the person discrimination mtor- 

(OSecuritydcgrccbyii^of^ P2. For example the face area of the usfi * is 

bc^imeriil extracted from thc image and the eye area is extracted from 

TT above embodiments, predefined security is the ^f^™ 6 ^!.^^^ 

activated for service or information. However, security 55 area. In this case, if a direction of the ^vjsuaj line is toward 

te^b ac^au^erent by unit of servicc/inforroalion. If a predetermined area (visual area of ihe screen an indica- 

fn^ed L^ is activated, useless interruption of Hon is outputted. If the direction of Ihe visual line is not 

iTwTa ™ ^fcen executed. 'This happeas in case of plural toward the predetermined area, another mdicaUon is output- 

workeT^mu mformariou equip mcT Accordingly, it is led. Tncse indicaUons represent visual Une information D5. 

l^^Xtc S is activated according to *e kind of ao £u thi, way, in the eighth embodiment, the visua^ line 

l^^r^^ol For example, assume that electric inf ormationDS is outputted to the service supply pe™on 

mail is transmitted using a PC (personal computer) or a section 2 as one of the person information. FIG. 12 is a flow 

£i?S^Sd usfng WP(word processor). Wral chat of process of die 

services are then supplied on the display of the equipment. 2 according to thc eighth embodiment. Id WO- 12, ^ . S2fi 

^TeTctrie mail reSresenis a privati f I eUer and its security 65 is added instead of step Sll m companson with FK3 3. 

Sree is high- On the other hand, the security degree of the During the supply of the service assume thai the sihiahon 

document by WP differs according to the kind of the deletion section 1 detects tha. the user is under a situation 
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*«*t » > . c«\ T«,hTer S «- the (ft Detection of visual line 3 (tenia embodiment) 

, ^rS ir„£ the user If the direciion or the user and the non-user cqntroUs the supply of tie service. 
me i v e to ^ SJLnLl area of the FIG. W is a flow chart of processing of the service supp y 

ES^Ttoc Mormntion D5 to the service supply F . G . 16, step S26 and step S27 arc added seeps in cornpan- 

2. The service ripply fission action son with FIG. 3. During the supply of the « 

2c»a t roUtbc«rvicc S uppl y sccripn3toir 1 tcrnipt^^ F ply tha t the situaaon detect™ section 

D f the service (step SJ2). FIG- 13 is a schematic diagram of under a situation to be supplied the service ( Yes at step 

J£taT^raTvi«S line, of the user in the image 10 g^jai&c^.lto^lin***^*^™*** 

SXtotheeir^thcmbodimenU As shown in HO. 13, movement of the visual line of the user II the visual hnc of 

S lines of the user ar= detected from position of ft, „ se r departs from the predetermined area, for eampfe, 

black eyes of the user's face in the image. the user rums his eyes away from the display ( Yes al step 

L flL wav in the eighth embodiment, detection of the S26), «he situaUou detection seclion 1 outputs the v^al hne 

• ?f r£ J ^LnrZTus (bTZvvU of the serrice. « information DS to the service supply permission section 2. 

lS£T 5£ S^-^SftStof the user, Then, the service supply permission section 2 

of tt?urvLfe kept only if the vfeual line of the service supply section 3 to mtermpi the supply of the senacc 

user departs from the display. (step S12), 

. , - , i .™k-.^; m ^nrt On the other hand, assume that the direction of the user 

(h) Detection of visual hue 2 (ninth embedment 20 ™ ™ « predetermined areaof the display (the user does 

fa the eighth embodiment, a dtodta. -f £ of P° * JP ^ ^ P ^ ^ ^ 

ihe user control the supply *& m ^*£^* ^foe situation detection section 1 detects that the non-user 
another person loots furtively at the display behind ieusur jnam ^ m ^ 

the supply of the service can not be ^f"^*^' Ue the visual line detection section 16 keeps watch for 

turns his eyes away from the display » mo vem*nt of the visual line of the non-user. If the direct 

person walks behind the user, Ihe supply of the j*nw» » ofthcvjRuaUineo f ihenon-user points to the predetermined 

interrupted to every time. Therefore in 1 the o ntn non-uscr watches the display behind 

embodiment, detection of the visual hne ot (he non-user ^ * ^ ^ siluatio(J dotccn - on 

controDs the supply of the service. ! oupute die ^al lme Mcrmalion to Ac service supply 

FIG. 14 is a flow chart of processing of tne s 6 ™" supply 30 permission section 2. The service supply permission section 

permission section 2 according to the ninth embodiment. In 2 g^^rj,. u, e service supply section 3 to interrupt Ibe 

FIG. 14, step S27 is added step between step Sll and step g[ ±g (step SU j 

S12 in comparison with FIG. 3. In this case, the visual Ime ^ embodin)en i, detection of the 

detection section 16 detects the visual line of the non-user ^ ^ ^ ^ ^ 

In case the person is not dismounted by referring to the 3S Therefore, the sccurily of the service Tor Ihe 

person discrimination information D2 (the person IS decided * suenathened 

■ t0 he a non-user) ^e <JJ 5 lb* "to *£>. ninth, tenth embodiment, the v^al lb. of 

SlXil^ ~ iTS^S ^m £ faC »e user A non-user is detect H = by d-ticg 

tnorS Ihe non-user and the eye are. is extracted Trom Ihe «„ a direction of a face of the user or non-usec .the supply of to 

ScVS. Tte visual line of the eye arc. is pursued. Jf a service may be controlled. In tins case as for the _use rf he 

diction of the visual line of the oo»W pota* * * direcUon of the user's face does not point 1 £ ^ d^lay^ the 

pret ermined area (visible area of the display), an indica- supply of the service is uiterrupted. as tot r the ^non-user ,d 

Son U outputted. If Ihe direction of Ihe vfaual line of Ibc me direetan of the non-user's face pomls to the display, the 
non-user does not point to the predetermined area, another aS su PP lv ° f *» -«v» » internrpted As for the pelhod 1 for 
SSta , U ourpu^. This purport is represented as the detecting th. rhrecnon of the face, the face area is exacted 

^^S^So^ section 1 depots that the direction of the face * pursued accord^ to he face area, 

rwn-iiscrinfririges the security of the non-user ("Yes" at step In the above embodiments, the image ,s used for detectmg 

Sll) In this case the visual hne detection seclion 16 keeps so the person infonnarion. However, sou D d or wireless may be 

watch for the move of the visual line of the user. If the used Tor detecting Ihe person information. In case of the 

direction of the visual line of the non-user points to *e sound , the user is specified by the user's voice existing in 

predetermined area, for erimplc, the non-user watches the the service-use area. If the user's voice is continuously 

display behind the user ("No" at step S27). Ujc situulion detected, it is decided that the user is under a situation to be 

detection section J outputs the visual line information to the 55 supplied the service. If a voice other than the user s is 

service supply permission seclion 2. Tbe service supply detected, i is decided that the security of the service of the 

permission seclion2 control!* Ihe service supply sections lo user is infringed. In case of the wireless the unspecified 

interrupt the supply of the service. FIG. 15 is a schematic by detecting ID information of a wireless card. Jhe user 

diaeraBT.ofdctcctionofilicvisuiaiiiiesofrhc non-user in the previously brines the wireless card wtfh him. U the ID 

imalreaccordkgtoLher^Acmbodiiiient.AssbowninnG. 60 information of the user's wireless card is continuously 

IS the visual lines of the non-user arc detected from detected, it is decided thai the user is under a situation to be 

Wion of black eves of the non-user's face in the image. supplied tbe service. If ID information other than the user's 

"Tnlis way> embodiment, the detection of the -ft - « * b detected^ it is decided that the security of the 

^\ ma Jkon 0 ^TCo am ^^m>lyoUh, S t^. serv.ee of the user ^ infringed. 

Store, in case the non-user looks furtively at the display as FIG. 17 is a schematic diagram showing a method of 

S£ »a the security of the service for the user is supplying a software for the present invention. A series of 

BL,Diiw , j processings of the service supply permission section 2 
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